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Abstract 

General relations are found between the measure of the uniformity of distributions 
on the phase space and the first moments and correlations of extensive variables 
for systems close to thermal equilibrium. The role played by the parameter of the 
Renyi entropy for the analysis of their fluctuations and correlations is studied. An- 
alytical results are verified and illustrated by direct simuations of quantum systems 
of ideal fermions and bosons. Problems of finite statistics, usual in experiments and 
simulations, are adressed and discussed and solved by finding unbiased estimators 
for Renyi entropies and uniformities. 
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1 Introduction 



Fluctuations and correlations in complex system provide unique information 
about its stability, scales and ranges of interactions between its constituents, 
and about qualitative changes in the system as a whole, as e.g. in phase 
transitions. Studied at the microscopic level, such phenomena affect random 
variables on the phase space and, in particular, their local properties reflected 
in shapes or structure of singularities of their distributions. On the other 
hand, they also influence global characteristics of the system, usually seen in 
moments of random variables. Typical examples are relations between scales 
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of correlations or strengths of intermittency and behaviour of thermodynamic 
potentials and quantities directly derivable from them, in particular thermal 
susceptibilities connected to variances of extensive variables, as specific heats 
or compressibilities. 

The structure of the phase space can be studied using different formal tools. 
Interesting from the physical point of view are links between mathematical 
properties of random variables on the phase space and observables for the 
system, either global, as e.g. moments of variables representing the system 
as a whole, or local, as characteristics of the phase space subsets related to 
subsystems. In our previous work [1] we found relations between equilibrium 
thermodynamics and the measure of the uniformity of the phase space, the 
latter being originally proposed in ref. [2] in the context of multifractal sets 
and formulated in terms of generalized entropies or fractal dimensions. In 
particular, we expressed the uniformity through thermodynamic potentials 
in the framework of the canonical and the grand canonical ensambles and 
proposed such approach for estimation of phase proportions in the vicinity of 
critical points. 

In the following paper we develop the idea further and show how the uniformity 
of the phase space, being itself sensitive to local properties of the measure, 
can be used for direct calculation of first moments of such phenomenological 
global random variables as the total energy or the number of particles in the 
system. We also show that the control parameter of the uniformity is at the 
same time the scaling parameter for intensive variables, as the temperature 
and the chemical potential, thus offering better understanding of relations 
between properties of complex systems at different scales. 

Basic assumption for both the previous [1] and the present works is that 
the system is in its stationary state, normally thermal equilibrium, or not 
far from it, which means that the probability densities are constant in time 
or quasistatic and the concept of temperature as a non-random parameter 
does make sense. Apart from obvious interest in finding phenomenological in- 
terpretation for purely theoretical concept of the uniformity, our motivation 
for such effort is driven by experimental practice. In many situations, one 
reasonably believes that stationarity conditions are fulfiled and probability 
densities can be estimated from data samples, but the equilibrium tempera- 
ture of the system is unknown and hardly measurable directly. Good examples 
for that are sets of remnants of nuclear disassembly processes in high energy 
collisions or that of stellar evolution where parts of final states are not de- 
tected or even not detectable at all because of experimental limitations, as 
hardly detectable neutrinos or objects out of aparatus acceptance. Since the 
formalism can be applied to wider class of systems and phenomena, as e.g. 
to analyses of transportation networks or finance markets, for such cases pa- 
rameters corresponding to the temperature or chemical potential do not even 
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have clear operational interpretation and are not measurable just because are 
not observables sensu stricto. As can be seen below, using uniformity one can 
predict the temperature evolution of the system from data taken at unknown 
temperature and eventually determine the temperature from the shape of the 
curve. In addition, the uniformity function is parametrized by the real number 
which controls its sensitivity to different regions of the phase space, thus using 
experimentally available information in the most efficient way. 

Following A. Renyi [3a,3b] we introduce generalized entropies I q , parametrized 
by the real number q 



lMnES A) p?, q*l 

(1) 

-£i!S A) Pi In pj, q = l 



where the phase space is divided into M(A) numbered cells, {Aj}^ A \ of the 
same volume A and 



Pi = 

A, 



/ d/i (2) 



d/x being the measure. All sums run only over cells where Pi ^ 0. 
Generalized Renyi dimensions are defined as 



D g = - lim -\. (3) 

All D q s are positive and are monotonically decreasing functions of q. By con- 
struction, the Ig and D q are sensitive to non-uniformities of the measure on the 
phase space and q may be used as a control parameter to specify the regions 
of the phase space one wants to monitor. In particular, for large positive q, 
only cells with the largest probabilities contribute to I q and D q , thus making 
it sensitive only to the regions with highest event frequencies, and opposite 
to that, for large negative q, only regions with small probability density con- 
tribute. In order to quantifiy the notion of uniformity and to standardize it, 
we use the Beck uniformity [2] 



Dg + q(q ~ l)D' q 
D q + (q- l)D' q 

I q + q(q - l)I' q 
' I q + (q-l)I' q 
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where ' stands for derivative over q. For all q, < 7 g < 1 and 7 g = 1 and 
7 g = correspond to the most uniform and the most non-uniform probability 
densities, respectively. More detailed discussion of the properties of j g can 
be found in refs [2,1]. It is worthwhile to note that 7 g can be defined in eq. 
(4) using both I q and D q , as can be easily verified by following the line of 
argumentation leading to this final formula for ^ q in ref. [2]. This is particularly 
important for finite statistics estimates of 7 g and using it for description of 
local fluctuations, as discussed further in this paper. 



2 Equilibrium thermodynamics 



2.1 The canonical ensemble 



Consider the canonical ensemble with the probability measure^ 



d/i = zm e ~ mf,if)d ? d P (5) 

where E stands for energy, (3 = 1/T for inverse temperature and (r,p) for the 
phase space variables and 



Z{(3) = J e-W&dr dp (6) 

is the partition function, where integration is taken over the whole phase space. 
The Renyi entropy in this case is equal to 



h = ^T- q [^Z{qP) - q\nZ{P)}. (7) 

Using standard thermodynamics one finds a formula for specific heat at fixed 
volume 



Cv(qP) = q 2 (l - q)l'l ~ 2q 2 I' q 
and explicit formula (1) for I q leads to 



1 In order to siplify formulae, we use hereon units with the Boltzmann and Planck 
constants equal to 1 and, in simulations for finite systems, particles' masses m = 1/2 
and unitary volumes. 
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j 2 cv = {\n 2 p) q -(\npf q (9) 

where p = dfi/drdp. By standard thermodynamics we mean the limit of q — > 1 
where all quantities obtained from partition functions by using derivatives over 
q/3 reduce to those known from classical thermodynamics. In particular, Cv{qf3) 
in eqns (8,9) has the meaning of specific heat at temperature q(3 and is defined 
using the first and the second derivatives of the partition function over qj3. It 
is further related to the energy fluctuations at the temperature q{3, as given 
in eq. (11) below, and at q — > 1 one recovers the commonly known formula. 
The average (..) q in eq. (9) is over so called escort distributions [4] 



2^=1 Pj 

where PiS are given by eq. (2). 

Energy fluctuations are measured by the variance of energy 



Var[E(q(3)} = ^vM- (11) 

From formulae above it is easy to reproduce obvious boundary case of zero 
fluctuations for delta-like, or microcanonical, probability distributions 
d/i = 5(E — E )dE. For q — 1 one gets back usual thermodynamics, since 
Pit = Pi- 

Noteworthily, for any function of temperature A(/3), the temperature scaling 
is equivalent to modification of averaging prescription 



(A(qf3)) = (A(j3)) q . (12) 

This is understandable because any temperature dependence for macroscopic 
observables, being themselves mean values or functions of them, stays in the 
probability measure. The modification of the measure pi in case of Boltzmann 
like Pi ~ exp(—f3E) is just temperature rescaling. 

Using escort averages and formulae for 7 9 and its derivative we get 



l q = q- 



(lnp) g 



and 



(13) 
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(lnp) 9 

and cy (9) is given in terms of uniformity 



g 2 (i ~ qK 



cv(qP) = \: ?' q I q (15) 



where 



I q = const - exp / dr- — — - — -. (16) 
J (r-l)(r- 7r ) 



2.2 The grand canonical ensemble 



For the grand canonical ensemble, the number of particles iV in the system is 
a random variable and the probability measure reads 



dfj, N = 1 e P\»cN-E N (f N ,p N )] d f Nd ^ N ( 17 ) 

where \i c is the chemical potential and En is the total energy of the iV-particle 
state and S is the grand canonical partition function 



oo „ 

Z(P,» C ) = £ / e^ N - E ^^df N dp N (18) 
v=o 

where the integral is taken over the whole iV-particle phase space (r/v,pW). 
The Renyi entropy is equal to 



I Q = j^-[\nE(qfi c ,qP)-q\nE(fi c ,P)}. (19) 
Standard thermodynamics gives an expression for the variance of (3E — /i c N 



Var((3E - ^ c N)(q(3, q^) = (1 - q)I' q ' - 2I> (20) 

where the total energy E and the number of particles N are in general corre- 
lated, so that 
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Var(f3E - fi c N) = Var(pE) + Var(fi c N) - 2 cov((3 E , fi c N) . 



(21) 



Similar reasoning as for the canonical ensemble gives 



Var(PE - fi c N)(q(3, qi i c ) = (\n 2 p) q - (lnp)J 



(22) 



where p = J2n / ^n^Pn and {..) q is the escort average over 



P 



q 

Pi,N 



(23) 



v^oo q 
2^j=l 2^K=0 Pj,K 



and 



Pi,N 



J d/iAr 

A, 



(24) 



As for the canonical ensemble, for any function A(j3,fi c ), the escort average 
is equivalent to the normal average for the temperature and the chemical 
potential scaled by q 



where I q is given in terms of ^ q by eq. (16). 

It has to be noted that the meaning of the q parameter, as used in present 
work, is not the same as for the Tsallis entropies (cf. e.g. ref. [5]) where it 
measures the degree of non-extensivity of that functions and may be further 
related to some properties of interactions in the system, as e.g. their effective 
ranges or, more generally, to the range of correlations. Although for both 
the Renyi and Tsallis entropies the q contributes via terms pf, thus making 
them both sensitive to frequent or non-frequent events on the phase space, 
depending on the value of q, but the properties and physical meaning of them 
are quite different. 



{A(q(3,qfi c )) = (A(P,fi c )) q . 



(25) 



Finally, the variance of (3E — jj, c N can be expressed via 7 9 




(26) 
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3 Local fluctuations and estimators of D q , I q and 7 g 

For random variables represented by non-singular and smooth probability den- 
sity functions, their Renyi dimensions do not depend on q and the uniformity 
is equal to 1. This is normally the case when the random variable represents 
total number of particles in the system. But such approach is not suitable 
for description of local fluctuations. In this case one has to consider densities 
being themselves random variables and dependent on the phase space random 

— * 

variables X n , as e.g. invariant density 



for which D q does exhibit non-trivial dependence on q. Unfortunately, for 
finite statistics one cannot calculate directly an exact value of D q and has to 
use an estimator for it. The usual method, known since at least two decades 
[6a,6b], is to plot I q as a function of In A (cf. eq. (3)) and determine the 
estimator D q for D q from the slope. Similar method was also used in ref. [7] 
for determination of non-Poisson fluctuations in rapidity distributions from 
factorial moments dependence on the bin size. Such estimators are usually 
consistent but the problem of finite statistics is still there: for small cell size 
A, where the estimate of D q is most reliable, we are out of statistics. 

As mentioned above, the 7 5 can be calculated using either D q or I q (cf. eq. (4)). 
Therefore, an alternative way is to determine the estimator 7^ for 7^ defined 
in terms of I q . We managed to find an unbiased estimator 7^ using finite cell 
sizes and thus we are sure that finite statistics of experiment or simulation 
does not affect our measures in any systematic way. 

It is commonly known that for the total number of events N, of them being 
in the i-th bin A,, the estimator pi = rii/N of pi is unbiased. Formal proof is 
easy when pi is represented as 



n=l 



(27) 



Pi = T? 



E e *(*») 



(28) 



3=1 



where 0, is an indicator function for the i-th bin, defined as 



1, 



xeAi 



(29) 



0, otherwise 



For any integer I > 1, the unbiased estimator for p\ is 
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since the expected value of p\ is 



E &i) = ^NT- £ E[e i (x jl )...e l (x jl )} (si) 

and the number of non-zero terms, all of them equal to 1, at the righthand 
side of eq. (31) is equal to n^.jijii — /)!. In the limit of infinite statistics 



An obvious condition rii > I in eq. (30) requires that statistics in each bin 
cannot be lower than the exponent /. This limitation is even favourable from 
the numerical viewpoint, because for large \q\ the uncertainties of pi propagate 
rapidly and so it is good to keep them limited. If the condition rij > I is fulfiled 
then the relative statistical error on p\ does not exceed y/l. 

This result can be extended to any real exponent q, requiring continuity of 
the estimator with respect to q and using known properties of the gamma 
function, leading to the following estimator 



P q i = ^ II (n + k-q). (33) 

k=l 

Because of linearity of the expected value operation, any sum of terms pf is 
unbiased. 

The 7 g is an analytic function of PiS (i — 1, . . . , M(A)) and can be represented 
as a power series of terms pUpII • . . . • pj™. Since PiS are independent of each 
other, except for marginal dependence from normalization, an expected value 
of the product factorize 



and 
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is an unbiased estimator for j q . The only caveate can be raised for the limit of 
M — > oo, but we do not go to zero with the cell size A and M remains finite. 
We find this feature of our estimator advantageous when one does not aim to 
estimate dimensions but only entropies, sufficient for finding uniformity, This 
completes our construction. 

Some numerical studies of the statistical bias of 7 9 are given in the appendix. 



4 Simulations for ideal quantum systems 



We illustrate our theoretical results by applying them to grand canonical en- 
sembles of ideal systems of fermions of spin 1/2 and bosons of spin 0. Let 
M denote the number of states of energies e r , and n r are occupations of 
states (r = 1, . . . , M), where n r — 0, 1 for fermions and n r = 0, 1, 2, . . . for 
bosons. Then N = J2rLi n r is the total number of particles in the system and 
E N = X^ii e r^r is the total energy of the iV-particle system. The occupation 
numbers {n r }^L 1 are the only random variables in this problem. 



4-1 The formulae 



Using notation 



/3(/i c — er) 



the grand partition functions are 



(36) 



InS: 



= < 



fermions 
bosons 



Ef =1 ln(l + i r ) 
-££iln(l-a; r ) 

— X^li hi(l — (n r )) fermions 
Y^Li l n (l + ( n r)) bosons 



(37) 



where 



(n r ) 



fermions 
bosons 



(38) 



and the probability distributions for occupations of states are equal to 



10 



, t4mt r : fermions 
p(n 1 ,...,n M ) = {H =1 V+*r) (39) 

- x r )x^ r bosons 

Complete set of formulae for the mean, variance and covariance of N and E, 
and for Renyi entropies and the uniformities is given below: 



, (N) — Y.^LJn r ) 2 fermions 
Var(N) = { V ' r " lV ' J (40) 

(iV)+Ef =1 K) 2 bosons 



Var(E) = < 



Ef =1 (K) - K) 2 ) e 
E^(K> + <n r ) 2 )e 



fermions 
bosons 



(41) 



cov(iV, £) 



<£>-Ef =1 K> 



fermions 
bosons 



where (TV) = E^iiK) and (£> = E^liKK, 



(42) 



iE^M(l + (nr»«-(nr)1 



ermions 



bosons 



(43) 



M In 2 fermions 

(44) 

oo bosons 



, -E r= ihi(l - (n r )) fermions 
Ioo={ (45) 
E r =i hi(l + (n r )) bosons 



and 



^ = ? - y^M (l/(n r )-l) 9 ln(l-(n r ))+ln(n r ) /<™ n S (46) 
^r=l (l/(n r )-l)9+l 
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and 



XtLMO- + (rh)) q - (rh) q ] , (A7 , 

7< ?~ 9 V M (l/(» r )+l)-?ln(l+(n r ))-ln(» r ) 0OSO71S \±t ) 

^r=l (l/(n r )+l)«-l 



4-2 Numerical results 



Numerical simulations for finite and bounded systems of ideal fermions and 
bosons were performed by choosing randomly occupations of states n r accord- 
ing to the probability distributions (39). Energies e r were determined from 
the wave equations for particles in a cubic box. Simulations were performed 
for q e [0.01, 10] in steps of 0.15. This means that each quantity, as variances 
of E, N, their covariances and uniformities, are calculated for each q. Then 
they are plotted, either as functions of q in figs 1 and 2, or pairwise as ^ q vs. 
Var(E') etc., in figs 3 and 4. 

In case of fermions the system consists of N — 10 particles, the number of 
states M is equal to 12 and the total number of configurations probed is 
10,000. 

For bosons, the system contains iV = 10 particles, the number of states M = 4 
and the number of configurator is equal to 10,000. Simulations were per- 
formed for two temperatures, T = 0.6 K and T = 3.6 K. The temperature of 
Bose-Einstein condensation for this system is equal to 0.8 K. 

In figs 1 and 2 the variances of the internal energy and the total numbers 
of particles and covariances of those two are plotted for two temperatures 
as functions of the temperature scaling parameter q. Fig. 1 corresponds to 
fermions and fig. 2 to bosons. One observes the variance of N for bosons being 
decreasing function of temperature, unlike the other variances and covariances 
for bosons and fermions. This is due to the specific temperature dependence 
of those quantities for bosons, with the T 2 term for Vax(E) and cov(E, N) and 
no such term for Var(iV) (cf. e.g. ref. [8]) and also to the fact that T = 0.6 K 
is below and T = 3.6 K is above the critical temperaturwe. 

In figs 3 and 4 the unbiased estimators ^y q of the uniformities 7 g are shown as 
functions of the variances of E, N and their covariance, for two temperatures. 
Fig. 3 refers to fermions and fig. 4 to bosons. The maximas 7 g = 1 correspond 
to q — 1. 
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5 Conclusions 



Our results illustrate general relations between characteristics of the probabil- 
ity measure on the phase space, viz. the uniformity of it, and thermodynamics 
of the system, thus providing with physical interpretation for the geometry 
of the event sets. Their features were discussed in more detail for systems of 
fermions and bosons and, in particular, the behaviour of relevant quantities is 
illustrated by simulations in figs 1-4 and discussed in chapter 4.2. 

Figs 1 and 2 illustrate how the temperature evolution of fluctuations of exten- 
sive quantities and their correlations can be predicted using the measurement 
at one temperature, corresponding to q — 1 for each temperature. 

As seen in figs 1-4, the shapes of curves are sensitive to the temperature. 
In case of experimental data this allows for determination of the equilibrium 
temperature or, in general, the Lagrange coefficients of the problem, by fitting 
simulated curves. 

An important advantage of the approach presented in this paper is that by 
increasing q one probes those regions of the phase space where the probability 
density is most peaked. As seen in figs 1 and 2, fluctuations and correlations 
of extensive variables are decreasing functions of q. However, if the set of 
events under study is a mixture of signal and background events and if the 
background is distributed over the phase space more uniformly than the signal, 
which is often the case in experiments, the regions probed with high q normally 
exhibit higher signal-to-noise ratio. If the background is not separable from 
the signal on event-by-event basis, any quantity measured with high q, also 
fluctuations and correlations, may be less biased systematically. 

In this work we found general relations between Renyi entropies, or Beck 
uniformities, and first moments and correlations of extensive variables for sys- 
tems close to thermal equilibrium. The role played by the degree parameter 
q for the analysis of fluctuations and correlations was studied. Our analytical 
results were illustrated by direct simulations for ideal quantum systems. Prob- 
lems of finite statistics in simulations or experiments were solved by finding 
unbiased estimators for expressions like pf and analytical functions of them, 
in particular for Renyi entropies and uniformities. 
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A Notes on bias for estimators of 7 9 and numerical stability 

In order to understand effects of statistical bias for finite statistics, we per- 
formed comparative analysis of estimators of j q . The unbiased estimator j q , 
as described in chapter 3, was compared to the biased estimator j q , calculated 
directly from formula (4) using estimator pi = rii/N for (28), but using 
estimator p\ = pi for p\ , and not that given by eq. (30). In figs A.l and A. 2 
we present the ratio R = %/% — 1 which illustrates the bias of the estimator 
7 9 for our simulations for fermions and bosons. 

As seen in all figures, in the limit of q — > 0, R is large negative which cor- 
responds to strongly underestimated j q . Also, the bias becomes more pro- 
nounced for higher q, as compared to 0.5 < q < 3. Such behaviour is due to 
the fact that for both very large and very small q, the 7 g is smaller than for 
q ~ 1 and there is more modestly populated phase space cells. These cells 
stronger contribute to the bias because (ni/N) 1 well approximates p\ only for 
high statistics (cf. eq. (32)). 

In all cases additional checks were performed whether effects we observe are 
not due to numerical uncertainties which can be significant for |g| ^> 1. In 
order to minimize numerical effects we made our calculations with accuracy 
of 70 digit numbers, using Mathematica software [9]. We found that unbiased 
estimators 7 q are in good agreement with analytic results (46,47). This con- 
vince us of reliability of our simulation and smallness of marginal bias to the 
unbiased estimator 7 9 which might eventually have come from the constraint 
Pi + . . . + pm = 1, making piS not perfectly independent, as mentioned in 
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Fig. 1. Results of numerical simulation for the ideal fermion gas: the variance of 
internal energy vs. q (upper left), the variance of the total number of particles vs. q 
(upper right) and the covariance of internal energy and number of particles (lower). 
In all figures thicker curves with points correspond to T = 0.1 K and the lighter 
ones to T = 1.1 K. 

chapter 3. An exception is the case of high q for fermions at T = 0.1 K. This 
case exhibits numerical instability, seen as intermittency for high q in the 
upper left panel of fig. A.l. This happens for both estimators and is due to 
relatively large number of poorly populated phase space cells, and thus small 
probabilities for them, which substantially contribute to strong propagation 
of rounding errors for high q. For higher temperatures the uniformities are 
usually higher, there are less terms with small PiS and such effects tend to 
disappear. 
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Fig. 2. Results of numerical simulation for the ideal boson gas: the variance of 
internal energy vs. q (upper left), the variance of the total number of particles vs. q 
(upper right) and the covariance of internal energy and number of particles (lower). 
In all figures thicker curves with points correspond to T = 0.6 K and the lighter 
ones toT = 3.6 K. 
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Fig. 3. Results of numerical simulation for the ideal fermion gas: the uniformity 
vs. internal energy variance (upper left), the uniformity vs. total particles variance 
(upper right) and the uniformity vs. covariance of internal energy and number of 
particles (lower). Curves are drawn to guide ones eye. Continuous curves correspond 
to T = 0.1 K and the dotted ones to T = 1.1 K. For all uniformities their unbiased 
estimators are plotted. 
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Fig. 4. Results of numerical simulation for the ideal boson gas: the uniformity vs. 
internal energy variance (upper left), the uniformity vs. total particles variance (up- 
per right) and the uniformity vs. covariance of internal energy and number of par- 
ticles (lower). Curves are drawn to guide ones eye. Continuous curves correspond 
to T = 0.6 K and the dotted ones to T = 3.6 K. For all uniformities their unbiased 
estimators are plotted. 
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Fig. A.l. The bias R = 7 g /7 g — 1 for the uniformity for the ideal fermion system. 
The upper left panel corresponds to T = 0.1 K, the upper right to T = 1.1 K and the 
lower left and right panels refer to the same temperatures as upper ones but show 
only the low q domain. 
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Fig. A. 2. The bias R = 7^/7^ — 1 for the uniformity for the ideal boson system. The 
upper left panel corresponds to T = 0.6 K, the upper right to T = 3.6 K and the 
lower left and right panels refer to the same temperatures as upper ones but show 
only the high q domain. 
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